Regression density estimation with variational methods and stochastic approximation
نویسندگان
چکیده
David J. Nott, Siew Li Tan, Mattias Villani and Robert Kohn, Regression density estimation with variational methods and stochastic approximation, 2012, Journal of Computational And Graphical Statistics, (21), 3, 797-820. Journal of Computational And Graphical Statistics is available online at informaworld TM : http://dx.doi.org/10.1080/10618600.2012.679897 Copyright: American Statistical Association / Taylor & Francis http://imstat.org/en/index.html
منابع مشابه
Bayesian parameter estimation via variational methods
We consider a logistic regression model with a Gaussian prior distribution over the parameters. We show that an accurate variational transformation can be used to obtain a closed form approximation to the posterior distribution of the parameters thereby yielding an approximate posterior predictive model. This approach is readily extended to binary graphical model with complete observations. For...
متن کاملVariational problems in machine learning and their solution with finite elements
Many machine learning problems deal with the estimation of conditional probabilities p(y | x) from data (x1, yi), . . . , (xn, yn). This includes classification, regression and density estimation. Given a prior for p(y | x) the maximum a-posteriori method estimates p(y | x) as the most likely probability given the data. This principle can be formulated rigorously using the Cameron-Martin theory...
متن کاملNonparametric variational inference
Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of variational approximations inspired by nonparametric kernel density estimation. The locations of these kernels and their bandwidth are treated as variational...
متن کاملAsymptotic Normality of Maximum Likelihood and its Variational Approximation for Stochastic Blockmodels
Variational methods for parameter estimation are an active research area, potentially offering computationally tractable heuristics with theoretical performance bounds. We build on recent work that applies such methods to network data, and establish asymptotic normality rates for parameter estimates of stochastic blockmodel data, by either maximum likelihood or variational estimation. The resul...
متن کاملWavelet Based Estimation of the Derivatives of a Density for a Discrete-Time Stochastic Process: Lp-Losses
We propose a method of estimation of the derivatives of probability density based on wavelets methods for a sequence of random variables with a common one-dimensional probability density function and obtain an upper bound on Lp-losses for such estimators. We suppose that the process is strongly mixing and we show that the rate of convergence essentially depends on the behavior of a special quad...
متن کامل